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Abstract — We consider spatially coupled code ensembles over a 
multiple access channel. Convolutional LDPC ensembles are one 
instance of spatially coupled codes. It was shown recently that, 
for transmission over the binary erasure channel, this coupling of 
individual code ensembles has the effect of increasing the belief 
propagation threshold of the coupled ensembles to the maximum 
a-posteriori threshold of the underlying ensemble. In this sense, 
spatially coupled codes were shown to be capacity achieving. 
It was observed, empirically, that these codes are universal in 
the sense that they achieve performance close to the Shannon 
threshold for any general binary-input memoryless symmetric 
channels. 

In this work we provide further evidence of the threshold 
saturation phenomena when transmitting over a class of multiple 
access channel. We show, by density evolution analysis and EXIT 
curves, that the belief propagation threshold of the coupled 
ensembles is very close to the ultimate Shannon limit. 



I. Introduction 

It has long been known that convolutional LDPC (or 
spatially coupled) ensembles, introduced by Felstrom and 
Zigangirov [1], have excellent thresholds when transmit- 
ting over general binary-input memoryless symmetric -output 
(BMS) channels. The fundamental reason underlying this good 
performance was recently discussed in detail in [2] for the 
case when transmission takes place over the binary erasure 
channel (BEC). In the limit of large L and w, the spatially- 
coupled LDPC code ensemble (l,r, L, w) [2] was shown to 
achieve the MAP threshold of (1, r) code ensemble (see last 
paragraph in this section for the definition of the (l,r, L,w) 
ensemble). This is the reason why they call this phenomena 
threshold saturation via spatial coupling. In a recent paper [3], 
Lentmaier and Fettweis independently formulated the same 
statement as conjecture. 

The phenomena of threshold saturation seems not to be 
restricted to the BEC. By computing EBP GEXIT curves 
[4], it was observed in [5] that threshold saturation also 
occurs for general BMS channels. In other words, in the 
limit of large 1 (keeping ^ constant), L and w, the coupled 
ensemble (l, r, L, w) achieves universally the capacity of the 
BMS channels under belief propagation (BP) decoding. Such 
universality is not a characteristic feature of polar codes [6] 
and the irregular LDPC codes [7]. According to the channel, 
polar codes need selection of frozen bits [8] and irregular 
LDPC codes need optimization of degree distributions. 



The principle which underlies the good performance of 
spatially coupled ensembles has been shown to apply to many 
other problems in communications, and more generally com- 
puter science. To mention just a few, the threshold saturation 
effect (dynamical threshold of the system being equal to the 
static or condensation threshold) of coupled graphical models 
has recently been shown to occur for compressed sensing [9], 
and a variety of graphical models in statistical physics and 
computer science like the random K-SXY problem, random 
graph coloring, and the Curie- Weiss model [10]. Other com- 
munication scenarios where the spatially coupled codes have 
found immediate application is to achieve the whole rate- 
equivocation region of the BEC wiretap channel [11], and to 
achieve the symmetric information rate for a class of channels 
with memory [12]. 

It is tempting to conjecture that the same phenomenon 
occurs for transmission over general multi-user channels. We 
provide some empirical evidence via density evolution (DE) 
analysis that this is indeed the case. In particular, we compute 
EXIT curves for transmission over a multiple access channel 
(MAC) with erasures. We show that these curves behave in 
an identical fashion to the curves when transmitting over the 
BEC. We compute fixed points (FPs) of the coupled DE and 
show that these FPs have properties identical to the BEC case. 

For a review on the literature on convolutional LDPC 
ensembles, we refer the reader to [2] and the references 
therein. As discussed in [2], there are many basic variants 
of coupled ensembles. For the sake of convenience of the 
reader, we quickly review the ensemble (l,r, L,w). This is 
the ensemble we use throughout the paper as it is the simplest 
to analyze. 

A. (l,r, L,w) Ensemble [2] 

We assume that the variable nodes are at sections [— L, L], 
L e N. At each section there are M variable nodes, M e 
N. Conceptually we think of the check nodes to be located 
at all integer positions from [—00,00]. Only some of these 
positions actually interact with the variable nodes. At each 
position there are check nodes. It remains to describe 
how the connections are chosen. We assume that each of the 
1 connections of a variable node at position i is uniformly and 
independently chosen from the range [i, . . . ,i + w— 1], where 
w is a "smoothing" parameter. In the same way, we assume 
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that each of the r connections of a check node at position 
i is independently chosen from the range [i — w + 1, . . . , £]. 
The design rate of the ensemble (l, r. L, w), with w < 2L, is 
given by 



1 1 w 

R(l,r,L,w) = (1- -) 

r r 



i-2£r= (4 



2L + 1 

A discussion on the above ensemble can be found in [2]. 

II. Channel Model, Achievable Rate Region, 
Iterative Decoding and Factor Graph 

A. Binary Adder Channel with Erasures 

We consider the simplest synchronous 2-user multiple ac- 
cess channel, the binary adder channel (BAC) with erasure. 
More precisely, the inputs to the MAC are binary X\,X 2 £ 
{0, 1}. The users take on the values 0, 1 with equal probability. 
The subscripts 1,2 denote the two users. The output Y G 
{0,1,2,?} is given by 

+ X 2 with probability 1 — e 
with probability e, 

where e is the fraction of erasures. 



Y = 



Z = X 1 

7 



B. Achievable Rate Region 

We assume that the two users do not coordinate their 
transmission. This implies that the joint input distribution has a 
product form. Let R\ and R 2 denote the transmission rates of 
the two users. The achievable rate region is given as follows. 

Ri <I{Xr,Y\X 2 ), 

R-2 <I(X 2 ;Y\X 1 ), 
R1+R2 <I(X U X 2] Y). 
The mutual information values above can be computed as 

I(X i; Y\X 2 ) = I(X 2 ;Y\X 1 ) = 1 - e, 
/(X 1) X 2 ;F) = 3 ^ ) 

I{X V ,Y) = I(X 2 ;Y) = i-^. 



The Shannon limit is defined as the ultimate erasure threshold 
below which both users can successfully decode using any 
decoder. Thus, the Shannon threshold is given by, 



min(l -R 1 ,1-R 2 ,1--(R 1 + R 2 )). 



(1) 



C. Factor Graph and Iterative Decoding 

Figure [T] shows the factor graph representation used in the 
BP decoder analysis. The channel output is the vector y and 
the user inputs are x x and x 2 . Each user has its own code and 
there is a function node which connects the two factor graphs 
(dark squares in Figure [TJ. This function node represents the 
channel factor node p(yi\xi y i,x 2 ^) and we call it the MAC 
function node (see [13], [14] for details). Figure [T] shows 
the spatially coupled ensemble used by each user. For the 
ease of illustration, we show the protograph-based variant of 
spatially coupled codes. If we do not use coupled codes for 




Fig. I . The figure shows two protograph-based spatially coupled codes (each 
belonging to one user) in light gray. The two protographs are connected by 
the MAC function node shown in dark. Note that in the actual code the MAC 
function node connects each variable node of one user to the corresponding 
variable node of the other user. For the ease of illustration, we just show 
connections across one-half of the variable nodes. 



transmission, then the two protographs above will be replaced 
by the usual LDPC codes. 

The BP decoder passes messages between the various nodes 
in the factor graph. The message passing schedule involves 
first passing the channel observations from the MAC function 
nodes to the variable nodes of both of the users, then perform- 
ing one round of BP for both the users (in parallel) and then 
sending the extrinsic information back to the MAC function 
node (from both the users). 

III. Uncoupled System: Density Evolution, 
Exit-like Curves 

A. Density Evolution 

Before we proceed to the analysis of coupled codes, it 
is instructive to consider the DE analysis for the uncoupled 
(1, r)-regular ensemble. More precisely, users 1 and 2 pick a 
code from the ensemble (li, ri)-regular and (I2, ^-regular 
respectively. From the schedule given above it is not hard to 
see that for finite number of iterations and large blocklengths, 
the local neighborhood around any node is a tree with high 
probability. See [13], [14] for more details on the DE setup. 
Also, the BAC with erasures can be thought of as a BEC (for 
either user) with erasure probability equal to e + (1 — e)/z/2, 
where p is the erasure message flowing into the MAC function 
node. Indeed, the channel output is either erased (wp e) or it 
is not erased (wp 1 — e) and we are still uncertain of the 
transmitted symbol if the output is equal to 1 (occurs wp 1/2) 
and the other symbol is uncertain (wp /1). The FPs of the DE 
are then given by, 
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where £1(1/1) and £2(2/2) are variable-to-check (check-to- 
variable) erasure messages of user 1 and 2 respectively. Note 
that ifl 1 =l 2 = l and ri = r 2 = r, then the above equations 
reduce to a single parameter equation and is given by 



(1 



x = ( e + ' 2 " Vl'l 

y = i-(i- x y 



B. Exit-like Curves 

We define the BP EXIT-liksfl function as follows. 

h BP (e) = + vY{l vl 2 ) + (l - yY)y 2 *. (2) 

An intuitive reason as to why we define the BP EXIT function 
as above is since the entropy of Zi = Xii + X 2 ,i is 
H (1/4, 1/4, 1/2) = 3/2 when a priori messages from both 
LDPC codes are erased and since the entropy of Z% is 1 when 
either of them is erased and the other is not. 

Assume that all the FPs are parametrized with x\ such as 
(xi,yi(xi),X2(xi),y2(xi),e(xi)). This assumption is true if 
(li,ri) = (l 2 ,r 2 ) = (l,r) with 

yi(xi) = 2/2(2:1) = 1 - (1 - xi) r_1 , 

x 2 (xi) = £1, 



e(xi) 



V2(xi) 1 
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We then have BP EXIT function as follows 

^ BI >i) =\yi{xi)^y 2 {x x Y> 

+ y 1 {x 1 )^{l-y 2 (x 1 )^) 
+ {l-yi{x 1 ) 1 ')y 2 {x 1 f\ 

We also consider the extended BP EXIT (EBP EXIT) curve 
which is the plot of all the fixed points of DE. In the case of 
codes (of each user) being picked from the same ensemble, 
the EBP EXIT-like curve is given by the parametric curve 
(h BF (x), e(x)), where x is the variable-to-check node message 
of either code. 

Example 1: Figure [2] shows the plot of the EBP EXIT-like 
curve for li = 1 2 = 3, ri = r 2 = 6. We choose this particular 
example since as seen from above it is easier to evaluate the 
value of e given a fixed value of x (the variable-to-check node 
message in either of the code). The BP threshold is « 0.12256 
which is much less than the Shannon threshold of 1/3. We 
observe that if we increase the degrees to (4, 8) for both the 
codes, the BP threshold dramatically drops to zero. Also note 
the C shape of the EXIT curve, indicating that there are exactly 
3 FPs including a trivial FP plotted at (0, e) for each channel 
value, similar to the BEC case. 

'The reason we call this function EXIT-like is because we do not provide 
any operational interpretation of these curves like the Area theorem [13]. The 
curves are drawn only to illustrate that the BP performance of coupled codes 
is close to the Shannon threshold, which is the main result of the paper. 



a. 

CO 



1.2 



0.9 



0.6 



0.3 




0-0 0.2 0.4 0.6 0.8 e 

Fig. 2. EBP EXIT curve for the case when both users pick a code from the 
(3, 6) and (3, 6). The BP threshold is w 0.12256 and the Shannon threshold 
is 1/3. 



IV. Main Results 

In this section, we analyze the performance of coupled 
codes over BAC with erasures. We use the (li,ri,£, w) 
coupled ensemble for user 1 and (l 2 ,r 2 , L,w) ensemble for 
user 2. As a shorthand notation we use (li, ri, 1 2 , r 2) L, w) 
to denote both the ensembles. Our main result is that, via DE 
analysis, the BP threshold of the coupled ensemble is very 
close to the Shannon threshold given by ([TJ. Furthermore, 
by increasing the degrees, the BP threshold of the coupled 
ensemble goes to the Shannon threshold. 

Next, we develop the DE equation when transmitting using 
the coupled codes. 

A. Density Evolution for the (li, ri, 1 2 , r 2 , L, w) ensemble 

We develop the DE equations assuming that the two 
users use ensembles of different degrees. Consider the 
(1 1; ri, 1 2 , r 2 , L, w) ensemble. To perform the DE analysis, 
we already take the limit M — > 00 (the number of variable 
nodes in each section). 

Let xx t i, i € Z, denote the average erasure probability which 
is emitted by variable nodes at position i to check nodes at 
position i for user 1. Similarly define x 2 ^ for the user 2. For 
i ^ [-L, L], we set xxj — x 2 ,i = 0. For i E [— L, L] the DE 
is given by 

-1 



2/2,'. 
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We will use the notation e BP (li, ri, 1 2 , r 2 , L, w) to denote the 
threshold of the BP decoder when we use coupled codes for 
transmission. Also, we use e BP (li,rx, 1 2 , r 2 ) to denote the BP 
threshold of the underlying uncoupled ensemble. 



As a shorthand we use gi(x i '_ w , v . . . , x 

-mi/— 1 \i„\/l sr^w— 1 



to 



denote (e + i=*(£ Ej=o Vy+j) 12 )^ EJ=o Vi^+jY 1 ' 1 

_ 1 ) to denote (e + 



1,2 

i—w+l ' 



1,2 
C i+w- 



and also g 2 

Definition 2 (FPs of Density Evolution): Consider 
DE for the (li, ri, I2, r 2 , L, w) ensemble. Let 
x x = (xx-l,---,Xi,l) and x 2 = (x 2 _ L , . . . ,x 2 ,l) 
denote the vector of variable-to-check erasure messages for 
user 1 and 2 respectively. We call x-y and x 2 tne constellation 
of user 1 and 2 respectively. We say that (x^a^) forms a FP 
of DE with channel e if (x^a^) fulfills ^ for i 6 [— L, L]. 
As a shorthand we then say that (e,x^,x 2 ) is a FP. We 
say that (e, x-^a^) i s a non-trivial FP if either a^ or x 2 
is not identically equal to OVi. Again, for i ^ [— L,i], 

£l,< = 2^2, i =0. ■ 

Definition 3 (Forward DE and Admissible Schedules): 
Consider forward DE for the (li, ri, 1 2 , r 2 , Z, 10) 
ensemble. More precisely, pick a channel e and initialize 
= x_2 = (1, . . . , 1). Let x± and x 2 be the result of i 
rounds of DE for user 1 and 2 respectively. More precisely, 



x 



(*+i) 



and x 



(*+i) 



are generated from x\ and a2 2 by 



applying the DE equation ([3]) to each section i E [—L,L], 



= 5i(z 



2 — 10+1 ' ' 



1,2,W 



l), 



to denote (x^],x 2 ^). We 



where we use the notation a; 
call this the parallel schedule. 

More generally, consider a schedule in which in each step 
I an arbitrary subset of the sections is updated, constrained 
only by the fact that every section is updated in infinitely 
many steps. We call such a schedule admissible. Again, we 
call x\ and x 2 the resulting sequence of constellations. ■ 
One can show that if we perform forward DE under any 
admissible schedule, then the constellations x\ and x 2 
converge to a FP of DE and this FP is independent of schedule. 
This statement can be proved similar to the one in [2], [13]. 

For the case when li = I2 and ri = r 2 we have that for 
any FP, xi ti = x 2 ,i and y M = y 2yl for all i. 



B. Forward DE - Simulation Results 

In the examples below, the Shannon threshold is computed 
using equation ([TJ. 

Example 4 (Equal Degrees - BP goes to Shannon): 
We consider forward DE for the coupled ensembles. 
More precisely, we fix an e and initialize all x 1;i and 
x 2; i to 1, for i E [— L, L\. Then we run the DE given 
by <(3j till we reach a fixed-point. We fix L = 200. 
For li = I2 = 3 and ri = r 2 — 6, we have 
that e BP (3,6,3,6,200,3) » 0.332287. If we increase 
the degrees we get e BP (4, 8, 4, 8, 200, 4) w 0.333195, 
e BP (5,10,5,10,200,5) « 0.333286. We observe that by 
increasing the degrees the BP threshold approaches the 



Shannon threshold of 1/3. On the other hand for the 
uncoupled codes, e BP (3,6, 3, 6) w 0.12256 and for larger 
degrees the BP threshold is zero. 

Example 5 (Unequal Degrees - BP goes to Shannon): We 
also consider the more general case when the degrees are 
not equal. For li = 5, ri = 10 and 1 2 = 6,r2 = 13 we get 
e BP (5, 10, 6, 13, 500, 10) w 0.307647. The Shannon threshold 
in this case is equal to ps 0.307692. For l x = 9,r! = 10 and 
1 2 = 6,r 2 = 10 we get e BP (9, 10, 6, 10, 500, 10) « 0.59992 
and the Shannon threshold is = 0.6. 

C. EXIT curve plots 

We also show via EXIT analysis that the coupling of regular 
LDPC codes pushes the BP threshold (of the coupled systems) 
to the Shannon threshold. For the purpose of illustration of 
the threshold saturation phenomena we focus only on the case 
when li = I2 and ri = r 2 . Thus, the variable-to-check node 
messages, for any FP of DE, for both the users are equal (cf. 
(|3]l). Now, to plot the EBP EXIT curve, which is essentially 
the plot of all the fixed-points of DE, we define the entropy 
of a constellation as 



1 



X 



L 



2L + 1 

■i— — L 



Xli. 



To plot all the FPs of DE, we first fix a value of x G [0, 1] and 
then run the reverse DE process given in [4]. Briefly, we start 
with an initial variable-to-check message and run it through 
the check node. Then the appropriate channel value is found 
such that the resulting constellation has entropy equal to \- 
This process is run till we get an FP. Figure [3] shows the 
plot of the EBP EXIT curve for the (3, 6, 3, 6, L, 3) ensemble 
with L = 2, 4, 8, 16, 32, 64, 128, 256. We observe that the plot 
looks very similar to the case of single user transmission over 
a BEC. For small values of L there is a large rateloss and the 
EBP EXIT curve is to the right. As L increases, the rateloss 
diminishes and the curves move to the left. The limiting BP 
EXIT curve of the coupled system looks very similar to when 
we are transmitting over the BEC. It traces the BP EXIT 
function of the underlying uncoupled codes until the channel 
erasure value is very close to the Shannon threshold and then 
drops vertically to almost zero entropy. 

D. Shape of the Constellation 

Figure |4] shows the constellation of an unstable FP (which 
cannot be reached by BP). This FP is obtained via the reverse 
DE process. This special FP was the key ingredient in proving 
threshold saturation over the BEC [2]. Let us describe the 
(empirically observed) crucial properties of this constellation. 

(i) The constellation is symmetric around i = and is 
unimodal. The constellation has e 0.3323, which is 
close to the Shannon threshold of 1/3. 

(ii) The value in the flat part in the middle is w 0.6548 which 
is very close to the stable FP of DE for the underlying 
uncoupled (3, 6)-regular ensemble at e s» 0.3323. 

(iii) The transition from values close to zero to values close 
to 0.6548 is very quick. 
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Fig. 3. The EBP EXIT curve for (3, 6, 3, 6, L, 3) with L = 

2,4,8,16,32,64,128,256. The curve with light gray background is the 
BP EXIT curve for the uncoupled (3,6,3,6) ensemble. We see that as L 
increases the EBP EXIT curves of the coupled system moves to the left. The 
BP threshold of the coupled system is sj 0.3323 which is very close to the 
Shannon threshold. 
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Fig. 4. The unstable FP shown above has an entropy of 0.28 and is obtained 
via reverse DE. The constellation is symmetric around and is unimodal. The 
flat middle part has value close to 0.6548 which is the value of stable FP 
for the uncoupled system at £ S3 0.3323. Both the users have identical FP 
constellation. 

V. Discussion 

In this paper we show that, by using coupled regular LDPC 
codes when transmitting over the 2 user BAC with erasures, 
the BP threshold can be made very close to the Shannon 
threshold. In this sense, the coupled codes are threshold satu- 
rating. We demonstrate this by plotting EXIT-like curves. The 
behavior of these curves is very similar to when transmitting 
over the BEC. Even the shape of the constellation of an 
unstable FP of DE is same as the BEC case. Thus we believe 
one should be able to provide a proof of this phenomena on 
the lines of the BEC proof [2]. 

Another interesting question is to determine area theorems 
which will also further show that the BP threshold of the 
coupled system goes to the MAP threshold of the underlying 
uncoupled codes, when we consider finite degrees. To do this 
we would need to define an appropriate EXIT function. 

Lastly, it would be interesting to see if we can demonstrate 
the threshold saturation phenomena to more general MAC 
channels, like the 2 user BAC with additive Gaussian noise. 
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